FogAdapt: Self-supervised domain adaptation for semantic segmentation of foggy images

نویسندگان

چکیده

This paper presents FogAdapt, a novel approach for domain adaptation of semantic segmentation dense foggy scenes. Although significant research has been directed to reduce the shift in segmentation, scenes with adverse weather conditions remains an open question. Large variations visibility scene due conditions, such as fog, smog, and haze, exacerbate shift, thus making unsupervised scenarios challenging. We propose self-entropy multi-scale information augmented self-supervised method (FogAdapt) minimize segmentation. Supported by empirical evidence that increase fog density results high probabilities, we introduce based loss function guide method. Furthermore, inferences obtained at different image scales are combined weighted uncertainty generate scale-invariant pseudo-labels target domain. These robust scale variations. evaluate proposed model on real clear-weather synthetic non-foggy images scenarios. Our experiments demonstrate FogAdapt significantly outperforms current state-of-the-art images. Specifically, considering standard settings compared (SOTA) methods, gains 3.8% Foggy Zurich, 6.0% Driving-dense, 3.6% Driving mIoU when adapted from Cityscapes Zurich.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Semi-supervised Domain Adaptation for Weakly Labeled Semantic Video Object Segmentation

Abstract. Deep convolutional neural networks (CNNs) have been immensely successful in many high-level computer vision tasks given large labelled datasets. However, for video semantic object segmentation, a domain where labels are scarce, e↵ectively exploiting the representation power of CNN with limited training data remains a challenge. Simply borrowing the existing pre-trained CNN image recog...

متن کامل

Type-Supervised Domain Adaptation for Joint Segmentation and POS-Tagging

We report an empirical investigation on type-supervised domain adaptation for joint Chinese word segmentation and POS-tagging, making use of domainspecific tag dictionaries and only unlabeled target domain data to improve target-domain accuracies, given a set of annotated source domain sentences. Previous work on POS-tagging of other languages showed that type-supervision can be a competitive a...

متن کامل

Diverse Sampling for Self-Supervised Learning of Semantic Segmentation

We propose an approach for learning category-level semantic segmentation purely from image-level classification tags indicating presence of categories. It exploits localization cues that emerge from training classification-tasked convolutional networks, to drive a “self-supervision” process that automatically labels a sparse, diverse training set of points likely to belong to classes of interes...

متن کامل

Weakly-Supervised Segmentation of Non-Gaussian Images via Histogram Adaptation

Here we apply an active contour model that allows for arbitrary intensity distributions inside and outside the boundary of an object to be segmented in an image. Computationally, we estimate intensity histograms both inside and outside the current boundary estimate, and use these histograms to define an image energy as their log-likelihood ratio. Training the model with accurate example segment...

متن کامل

Mix-and-Match Tuning for Self-Supervised Semantic Segmentation

Deep convolutional networks for semantic image segmentation typically require large-scale labeled data, e.g., ImageNet and MS COCO, for network pre-training. To reduce annotation efforts, self-supervised semantic segmentation is recently proposed to pre-train a network without any humanprovided labels. The key of this new form of learning is to design a proxy task (e.g., image colorization), fr...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Neurocomputing

سال: 2022

ISSN: ['0925-2312', '1872-8286']

DOI: https://doi.org/10.1016/j.neucom.2022.05.086